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INTRODUCTION 


by 

L. F. Guseman, Jr. 

The organizational meeting for the NASA Fundamental Research Program in 
“Mathematical Pattern Recognition and Image Analysis” (MPRIA) was held at the 
NASA/Johnson Space Center in August, 1982. At this meeting each of the fifteen 
principal investigators briefly outlined the goals of their particular proposed 
research efforts. Most of the efforts (those outside NASA) had just been 
funded (July 16, 1982), and investigations were just getting underway. 

In order to gain a better understanding of and stimulate discussions 
between the individuri research efforts, it was decided to conduct two techni- 
cal workshops at Texas A&M University about six months into the program. The 
first workshop was held January 27-28, 1983 and consisted of investigators from 
the "Mathematics/Statistics" areas. The second workshop was held February 3-4, 
1983 and consisted of investigators from the "Pattern Recognition" areas. 

Each of the workshops was conducted in an informal manner. Most of the 
time was spent in lively technical discussions about each of the research 
efforts. Additional time was spent discussing the availability of data sets. 
Or. R. P. Heydorn announced the availability of a data tape that has been com- 
piled for use by the research teams. Details concerning the content and format 
of the tape are discussed in the document entitled "Fundamental Research Data 
Base" appearing in the Appendix of these proceedings. 

Agendas and lists of participants for the workshops appear in their 


respective Proceedings. 
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February 3-4,1983 
Room 308, Rudder Tower 
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8:30 - 8:45 

8:45 - 9:15 

9:15 - 10:30 

10:30 - 10:45 


Coffee and donuts 

Opening Remarks 

L. F, Guseman, Jr., TAMU 

Remote Sensing Fundamental Research Program: 
An Overview 

Howard Hogg, NASA Headquarters 

Textural Edge Detection in the Frequency 
Domain 

K. S. Shanmugan, University of Kansas 
Break 


10:45 - 12:00 


12:00 - 1:00 


Aspects of Simulation for Rectification 
Studies 

E, M. Mikhail and Fidel Paderes, 

Purdue University 

Lunch 


1:00 - 2:15 

2:15 - 2:30 


Image Matching Using Hough Transforms 
L. S. Davis and Azriel Rosenfeld, 
University of Maryland 

Break 


2:30 - 3:45 


Subpixel Registration Accuracy and Modelling 
L. N. Kanal , LNK Corporation 


3:45 - 4:00 Break 


4:00 - 5:15 


Discussion and Symposium Planning 
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W. R. Tobler, UC Santa Barbara 

9:45 

- 10:15 

Break 

10:15 

- 11:30 
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- 2:30 
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2:30 

- 4:00 

Progress in the Scene-to-Map Registration 
Task 

David D. Dow, National Space Technology Labs 
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TEXTURAL EDGE DETECTION; 

• Develop an optimum (global) textural edge detection 
operator based on statistical models for texture. 


SENSITIVITY ANALYSIS: 

•Analyze the effects of the imaging process on the 
textural patterns of a scene as It appears in the 
image — i.e., separate scene-induced textural 
patterns from sensor-induced textural patterns. 
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• Texture 



Primitive Elements 
Structural Arrangement 


I X(t) 

••• A A A In n n n n ••• 

t 


• Textural Edge Detection Operators*. 

• Local Operators 

• Global Operators 
•Optimum 

• Let X(t) - Xj(t) [l - u(t-tjj)j + X2«) u(t-y + n(t) 

Want to process X(t) using a LTIV operator and produce Y(t) 
that best approximates s(t-to). Xi(t) and X2(t) represent 
random process models for two textural classes that form a 
boundary at t ■ tg. 


OPTIMUM TONAL EDGE DETECTION OPERATOR: 


ORIGINAL PAGE IS 
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I 



X(t) 


hit) 

LTIV 


Y(t) 



subjected to the constraints 


(1) |Hif)| • 0 for |f| > B 

(2) hit) is LTIV 



prr/^f«ini V 

OF POOR QUALITY 


OPTIMUM TONAL EDGL DETECTION OPERATOR 

• Soln; 

y(t) ■ 3j 0j(c,t) , c ■ BI/2 
H(cj) - y(w)/X(o;) 

„ 7 

2 ~cu) \t\ ^ o 
£j e , Ml ^ ® 

(edge model used: unit step and exponential) 


•An approach similar to the one described above can be 
used to derive an optimum textural edge detection •* 
operator. 


«ln order to derive an optimum textural edge detection 
operator we need: 


• random field models for texture 

• edge models 

• performance measure 

•frequency domain models for textural fields 


= y{o))A{G (f); 

Xi 


G, (f)) 
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FREQUENCY DOMAIN DESCRrPTIQN O F 
MARKOV TEXTURAL FIELD MODELS 


oo 

X(t) • £ A. p (H.) 

“OO I 


OF POOR QUAUTY 


A.[ * Amplitude sequence 


Pj, P 2 » •••» P|\| • ^ primitive elements 


|m. ; m. e [l, 2, n] indicates which one of the N 
primitives is present at the i-th location 



•Want to find G (f) 
X 


TEXTURAL FIELD MODELS 


OHI 


^ > i «4 


i ‘ 


ASSUMPTIONS: ^ *^OR quautv 

l.a. jtjj “ uniformly distributed locations 

1. b. jtjj - Poisson sequence with an exponential 

distribution for Inter-location distance 

2. a. I A. I : Constant 

2. b. |A.j ; Correlated sequence 

3. a. Pp p^ Pjg : deterministic shapes 

3. b. p^, P 2 * • • • * P|yj i random processes 

4. a jm.j : Independence sequence 

imjl : Homogeneous markov sequence 


u 

COMPLETED MOBFI. 

jt. I : uniformly distributed 
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: constant 


Pj. p2» •••» • cteterminlstlc 

l^jj : markov 
P joccurrence of p j ~ n 

K I )( 

P (occurrence of p. followed by p. after n locations) • p . 



Tj * average spacing between elements 


POWER SPECTRAL DENSITY: 
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+ 


Where: 


oo 


E 

n=-oo 



N 


1 

r ^”1 

*s j=l ^ 


2 

J 



! n n 

E E 7 T.s -(f) s/(f)Q..(f) 
j=l k=l J J 


S^(f) = F (Pj^(t)} 

S'" ■ ’ V" - 


M 

E 

j=i 


7T. p.(t) 

J J 


Pjlj<n) exp(-i 2 7T n f ) 
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SPECIAL CASE; 
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N*2 ; |m.| - Independence sequence; equal probability 


1 

E 


i'-r) 


+ ^ p(i-p) 
S 


Sj'(f) - S2'(f) 




RESEARCH PLAN: 
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•Generalize (2-dimenslonal, t= (x,y); Poisson) 
•Find FIG (f), G (f)j 

\ Xj ^2 ' 

(Edge model) 

•Test filters on simulated fields 

•Develop estimation procedures, test on actual 
Image data 


TDCTURAL EDGE DETECT! 


Approach; 

• Define appropriate measures (rf performance - 
What Is "optimum”? 

• Develop random field imxlels for different classes 

of textures (different means, covarlance/co-occurrence 
matrices) 

•Given X|(t) and X2(t) derive the transfer function of 
the optimum filter subjected to appropriate constraints 

•Modify the transfer function to take into account 
the presence of noise in the input image 

•Find a sub-optimum filter for a wide class of 
textural edges 

•Test the filter on natural and synthesized textural 
edges 
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SENSITIVITY OF TEXTURAL FEATURES 
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•Textural Patterns 
in an image 


scene or target induced 

sensor induced (due to sensor 
transfer function, geometry, 
nature of the illumination, etc.) 


•In a LANDSAT-type image, the textural patterns that 
appear in the image usually represent the textural 
patterns of the underlying scene (assuming that the 
illumination variations and shadows are minimum) 


•In a SAR Image of a scene with significant terrain 
relief, the textural patterns that appear In the image 
may be very different than the textural patterns in 
the underlying scene due to layover, shadowing, 
fading, etc. 


•Objective of the proposed research effort is to develop 
mathematical models and methodologies for evaluating 
the effects of the Ima^jing process on the textural 
patterns of a scene as it appears on the image 
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SENSITIVITY OF TEXTURAL FEATURES 


Elevation 

D(t) 
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Figure 1, Simplified View of the Radar Imaging Process. 
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Flight Path 


24 


ORIGINAL P:\CV. I'j 
OF POOR QUALIIY 








25 


QuAumr 


OF POOR 


SENSITIVITY ANALYSIS 


Rese a rch Plan; 

•Develop random process models of terrain elevation, 
and backscatter variations of typical scene categories 
(agricultural, fOi*estry, urban areas, hilly and 
mountainous terrains, water bodies, etc.). The 
models will be in a parametric form, and the scene 
texture will be described by the parameter values and 
the model type. 

•Develop simple parametric models for the imaging 
process of a SAR. 

•Using the scene model and the system model, derive 
the textural properties of the image parametric form. 

• For different scene categories, analyze the effect of 
Imaging system parameters on the features (parameter 
values) of the image textural patterns. 

•For different scene categories, compare the separability 
of the scene textures with the separability of the 
textural patterns of the corresponding images. 

•For the cases where the comparison could not be 
done by analytical methods, use simulated imagery 
to study the effects of the imaging syslem. 


ORIGINAL PAGE IS 
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The Influence of Sensor and Flight Parameters 
on Texture In Radar Images 

V.S. Frost» K.S. Shanmugan, and J.C. Hoitzman 


Remote Sensing Lalx>ratory 
University of Kansas Center for Research, Inc. 
Lawrence, Kansas 66045 


Abstract 

Texture Is known to be Important In the analysis of radar Images 
for geologic applications. It has previously been shown that texture 
features derived from the grey-level co-occurrence matrix (6LCM) can be 
used to separate large scale texture In radar Images. Here the 
influence of sensor parameters, specifically the spatial and radiometric 
resolution and flight parameters, I.e., the orientation of the surface 
structure relative to the sensor, on the ability to classify texture 
based on the GLCM features Is Investigated. It was found that changing 
these sensor and flight parameters greatly affects the usefulness of the 
GLCM for classifying texture on radar Images. 
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i. INTRODUCTION 

Spectral, textural temporal and contextual features are four 
Important pattern elements used In human Interpretation of Image data In 
general and SAR data In particular. Spectral features describe the 
average band-to-band tonal variations in a multi-band Image set, whereas 
textural features describe the spatial distribution of tonal values 
within a band. Contextual features contain Information about the 
relative arrangement of Image segments belonging to different 
categories, and temporal features describe changes in Image attributes 
as a function of time. However, when small image areas within, say, a 
synthetic aperture radar (SAR) Image are independently processed on a 
computer for automated analyses only the tonal and textural features are 
usually available In making decisions. 

in much of the automated procedures for processing radar Image data 
from small areas, such as In crop classification studies, only the 
average tonal values are used for developing a classification algorithm. 
Textural features are general ly Ignored on the basis that the poor 
resolution of radar Imagery does not provide meaningful textural 
Information for such applications since the areal extent of the target 
Is usually small. However, there are many other applications such as 
the Identification of large scale geological formations, land use 
patterns, etc., where the resolution Is more than adequate to provide 
textural Information. Indeed, In these applications, texture Is 
probably the most Important Image feature. It was previously shown []13 
that texture features derived from the grey- level co-occurrence matrix 
(GLCM) can be used to discriminate texture in radar Images. We describe 
In this paper the Influence of sensor and flight parameters on our 
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ability to quantitatively classify textures In radar images using the 
GLCM. The effect of spatial and radiometric resolution on texture 
classification was studied In one experiment. It was found that the 
classification was very sensitive to these sensor parameters, only the 
Image with the best spatial and radiometric resolutions was 
quantitatively useful. Another experiment was conducted to determine 
how different flight paths, l.e., looking at the same terrain from 
different angles with the same sensor and incidence angle, changed the 
texture classification. Optical imaging systems rely on the sun to 
Illuminate the scene and thus the sun angle becomes a factor; however, 
mission profiles for these sensors are usually designed to minimize this 
effect. For example, the LANOSAT series of sensors. uses a high sun 
angle. On the other hand Imaging radars provide their own Illumination 
and It Is not clear what effect observing the same geologic structure 
from different angles will have on the automated analysis. 

In the following section the texture features used here to separate 
different surface structures are briefly described. The sensitivity of 
these texture features to changes in radiometric and spatial resolution 
Is discussed next. Radar Image simulation Is then used to evaluate tho 
sensitivity of GLCM texture features to changes In the orientation of 
the surface structure and the radar. The results of the two studies 
described In this paper indicate that the usefulness of textural 
features In automated analysis of radar Images is sensitive to changes 
In the spatial and radiometric resolution of the system as well as the 
target/ sensor geometry. 
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II. The Texture Features 

The textural feature extraction algorithm employed here has been 
widely used for analyzing a variety of photographic images. The 
procedure is based on the assunption that the texture information in an 
image block 'I* is contained in the overall or 'average' spatial 
relationship which the grey tones In the linage '!' have to one another. 
This relationship can be characterized by a set of grey- I eve I 
co-occurrence (GLC) matrices. We de cribe a procedure for computing a 
set of GLC matrices for a given image block and define a set of 
numerical textural descriptors (features) that can be extracted from the 
GLC matrices. These textural features can be used .for automated 
analysis and classification of blocks of radar imagery. Image texture 
may be viewed as a global pattern arising from a deterministic or random 
repetition of local subpatterns or primitives. The structure resulting 
from this repetition could be very useful for discriminating between the 
contents of the image of a complex scene. A number of approaches have 
been suggested for extracting features that will discriminate belvjen 
different textures C2-63. Of these approaches. It has been found that 
textural features derived from grey-level co-occur .'ence matrices (GLQ4) 
are most useful for analyzing the contents of a variety of Imagery In 
remote sensing, biomedical and other applications C7-113* The GLCM 
approach to texture analysis is based on the cpnjecture that the texture 
Information In an image Is contained in the overall or average spatial 
relationship between the grey tones of the Image. 

The second-order grey- I eve I co-cccurrence matrix of an image Is 
defined as follows. Let f(x,y) be a rectangular digital picture defined 
over the domain xeQ0,nj^), yeC0,ny), x, ye I. Let ng be the number of 
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grey levels In f. The unnormal Ized, second-order GLC matrix Is a square 
matrix P of dimension ng, (l,J)-th entry In P, denoted by Pfj, Is a 
function of the Image tonal values and a displacement vector d - 
(di,d 2 ). The entries P|j are unnormal I zed counts of how many times two 
neighboring resolution cells which are spatially separated by d occur on 
the Image, one with grey tone I and the other with grey tone j. That 
Is» 


P|j = § |((m,,nj), (m2,n2))l f(m,,n,) = I, 

f(m2,n2) = j, and (m2»n2) “ (mj,nj) = ( 1 ) 

where # denotes the number of elements In the set, the Indices m^, m2 
and nj, n2 take on Integer values In the Intervals [ 0 ,nj^), [ 0 ,ny). The 
normal Ized GLC matrix P with entries p|j Is obtained from P by dividing 
each entry In P by the total number of paired occurrences. The 
definition of second-order GLC matrices can be extended to Include 
third- and higher-order GLC matrices. While higher-order GLC matrices 
may be Important In some applications, much of the recent work In 
texture analysis has been based on second-order GLC matrices. 

The second-order GLC matrices are computed for various values of 
the displacement vector d, and features derived from the GLC matrices 
are used for classifying the contents of an Image. 

Some of the commonly used textural features derived from the GLC 
matrix are; 
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I) Uniformity (sum of squares) 


u 
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2) Contrast: 


Z Z pij 

I j 


3) (Correlation: 


ZZ 

I j 


(l“Mx)(J-My) plj 


o a 

X y 


4) Entropy: 


ZZ Pij log p 


IJ 


I j 


5) inverse Difference Moment: 


• J 


6) Maximum Probabi 1 ity: 


:.ax p(j 

UJ 


(2a) 


(2b) 


(2c) 


(2d) 


(2e) 


(2f) 


For a variety of imagery (aerial, micrographic and x-ray) the 
relationship between these textural features, their values and what they 
represent In terms of visual perception of texture are reasonably well 
understood. Using features of the form given above, Haral Ick and 
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Shanmugan C5-73 were able to classify a variety of Images with over 85$ 
classification accuracy. These features have also been used to separate 
texture In radar Images CO* 

III. Texture Analysis of SAR Images with Different 
Spatial and Radiometric Resolution 

Numerical descriptions of texture (specifically those derived from 
the grey-level co-occurrence matrix (GLCM) as In Section II) have been 
shown to separate some simple geological features CO* To efficiently 
design a spaceborne SAR for geologic exploration It Is of Interest to 
determine how the ability to separate geological features using the GLCM 
desired features varies with Important system parameters, e.g., spatial 
and radiometric resolution. 

A limited set of radar Images with different spatial and 
radiometric resolutions were obtained (primarily from the Jet Propulsion 
Laboratory Cl23). These Images were generated b> appropriate processing 
of the Seasat-A SAR video signal, and were of a geologically Interesting 
area In Tennessee (Figure 1). The specific areas that were studied are 
outlined In white. The combinations of spatial and radiometric 

resolution contained In this data set were (25 m, 4 looks), (50 m, 4 
looks), (100 m, 4 looks), (50 m, 2 looks), and (50 m, 1 look). Within 
the Tennessee tes^ area, five distinct textures were Identified (see 
Table 1 for a description of the geology and topography) and five to 
seven samples of each texture obtained (see Figure 1). A sample of a 
texture Is an Image (In this case 3.4 km x 3.4 km In size) containing 
only one texture type. Thus for each set of sensor parameters 30 
texture samples were obtained, a total of 150 texture samples (Images) 
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were used In this study. For each texture sample a GLCM was calculated 
and texture features found. Specifically, uniformity, contrast, 
correlation, entropy, Inver difference moment, and maximum probabl I Ity 
were the texture features used here. Following CO the GLOl were 
calculated for distances of 1, 2 and 4 at angles of 0®, 45®, 90®, and 
135®. The above texture features were calculated for each distance and 
angle. I.. addition, the average over all angles for each texture 
feature was calculated. Thus each texture sample Is described by a set 
of 30 numbers (6 texture features, 4 angles, and the average for each 
feature) . 

Scatter diagrams of the numerical values for one pair of texture 
features are shown In Figure 2. These plots are for distance 4 and 
result from averaging all four GLCM angles. All five textures can be 
separated using the correlation and maximum probability (Figure 2) 
features only for the system with a 25 m spatial resolution and with 
four independent samples averaged. As either the radiometric resoiutlon 
Is degraded (decreased number of Independent samples or looks averaged) 
or the spatial resolution is degraded the ability to separate these 
textures Is also degraded. This same result was found for other 
combinations of texture features C13J. In all cases only the images 
with 25 m, 4 looks could be quantitatively used to separate these 
textures using the GLCM. 

This experiment reinforces the conclusions of our previous work 
CO; automatically derived texture features can be used to discriminate 
texture In radar Images of rough terrain. Additionally, this study 
shows that the ability to use the GLCM to classify texture Is strongly 
dependent upon both the sensor's spatial and radiometric resolution. 
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Even though the data set used for this stuOy was very limited these 
results do Indicate that the usefulness of textural features for radar 
Image analysis is sensitive to the spatial and radiometric resolutions 
of the sensor. This should be expected because It Is well known that 
for manual analysis the Interpretabi I Ity of radar images is sensitive to 
the radiometric and spatial resolutions C14-173. Thus, this study 
demonstrated that this sensitivity also exists for autcmatic analysis. 

IV. A_Studv of. the Effect of Look Direction On 

Texture In SAR Images 

For an automatic texture analysis system for radar to be 
successful, a set of texture features must be found which are invariant 
to the flight path of the sensor. This Invariance Is clearly needed 
because the orientation of the terrain features relative to the sensor's 
flight path Is not known a priori. For the geologic analysis of radar 
Imagery where terrain elevation plays a dominant role the Imaging 
geometry of radar would seem to be a dominant factor. Also the question 
of Invariance Is Important In the search for ’optimum’ sensor 
configurations. For example. It might be possible to classify certain 
terrain features at one sensor orientation but not at another. However, 
because the orientation of the sensor to the terrain features of 
Interest will never be known a priori an optimum sensor configuration 
might not exist. 

The purpose of this section Is to describe the results of an 
experiment which was aimed at determining the sensitivity of 6LCM 
>xture features, shown to be valuable as a discriminate, to the sensor 
flight direction, I.e., the target/sensor orientation. It was found 
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(given the I imitations of the experiment) that the texture features 
considered here could be classified for one or two target/sensor 
orientations but not for all the three orientations considered here. 

To Isolate the effect of sensor looK direction it was necessary to 
use radar simulation [[163 to create a set of images with controlled 
terrain and sensor parameters. Further it was possible using the 
simulation approach to remove (i.e. , not Include ) the effect of speckle 
Cl83* Therefore, this study focused on how shadow, layover, and range 
compression changed the image manifestations of complex terrain 
structure as the look direction of the sensor was varied. 

In radar Image simulation (for a complete description see Cl83)» 
the terrain to be analyzed Is represented as a two-dimensional integer 
ai'ray referred to as a data base. This array Is stored on a file 
containing fixed-length records. These correspond directly to rows In 
the array which contain a fixed number of words (columns). This 
relationship is shown In Figure 3. 

The three data bases used In this study were generated from data 
received from the U.S. Geological Survey In the form of three digital 
elevation models. These were received containing elevation values which 
correspond directly to a 1:24000 (1 Inch * 2000 feet) topographical map 
sampled at 30 meter Intervals In both the x and y directions. Let x 
define columns in our data base and y to refer to rows (see Figure 3). 
In these data x and y both represent 30 meters on the ground. Thus 
each elevation value was considered to be valid for an area of 30x30 
square meters. 

The third dimension of the data base, h, represents the elevation 
of each cell above a given i ef erence elevation. Each Increment In 
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elevation corresponds to Ah, which describes a scaling factor for 
(totermlning the quantization of the actual elevation. In the digital 
elevation models used In this study, the value for Ah was equal to one 
meter. This led to a convenient one-to-one relationship for the 
elevations. 

The relationship among the values for ax. Ay and Ah describes the 
degree to which the elevation changes over an area on the ground. Since 
only the relative structures of the terrain are of Interest In this 
study, this relationship may be altered as needed. After first removing 
the reference elevation constant the data was scaled by 0.23. This 
allowed the Ax and Ay values to represent 7.3 meters, while the value 
for Ah remained equal to 1 n»ter. 

The simulation of synthetic aperture radar Imagery is made possible 
through the application of a computer program developed at the 
University of Kansas Remote Sensing Laboratory CIO]. This algorithm 
will simulate the effects of a spaceborne SAR with a look direction 
parallel to the rows of the data base array. Since the simulation 
program always processes the data row by row, the only way to achieve a 
different look direction Is to modify, I.e., rotate, the data base. 
Keeping this In mind, the unmodified data base Is defined to be at a 
look direction angle of 0*. For this study simulated radar imagery was 
to be generated for t:»o same areas with look directions of 0®, 43®, and 
90®. This required that the data bases be correctly oriented before the 
simulation was performed. For this, computer programs were applied to 
rotate the original data In order to simulate different look angles. 
Nine data bases were thus available for simulation (3 terrain models at 
3 lool; directions). These nine data bases were then processed using the 
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simulation program. The radar paramatars usad for tha simulation wars 
similar to thosa of tha Saasat-A SAR. Tha altituda of tha sansor was 
considarad to ba roughly 800 kllomatars, and tha angia of Incldanca 
batwaan tha sansor and the first cal I of the data base was given to ba 
20 degrees. For tha purposes of this ^tudy. It was assumed that al 1 of 
the terrain data was of one scattering category. Tha scattering 
coefficient as a function of Incidence angle Is shown In Figure 4. 

Using these parameters along with tha assumed value of 7.5 meters 
for both along-track and across-track resolutions, radar Images were 
simulated, producing the desired sat of controlled Images. However, 
these Images are now rotated relative to each other. To eliminate the 
rotational dependence of the GLCM the simulations were converted to one 
coordinate system. 

Visually the effect of changing the flight path Is dramatic. 
Figure 5a-c contains the simulated radar Images for one of the digital 
terrain models. In Figure 5a the sensor's look direction is from right 
to left. This Is our reference direction and Is referred to as the 0® 
look angle. The simulation of a 45® look angle (I.e., from the upper 
left to the lower right) Is shown In Figure 5b and the 90® simulation 
(I.e., from top to bottcm) Is shown in Figure 5c. Similarly, Figures 
6o“C and 7a-c contain the Image simulations for two other digital 
terrain models. Close analys.s of these Images reveal s many features 
which are totally obscured by shadow at one look angle but not at the 
others as was shown In Cl 73* Also, the spatial structure changes as the 
look angle Is varied from 0® to 45® to 90®. 

Beginning with the 0® look direction three distinct spatial 
structures, textures, were Identified. 
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TEXTURE 1 contained loir relief with some small hills and riages, 
maximum relief Is about 100-300 feet. 

TEXTURE 2 contained elongated ridges and mountains usually 
separated by steep gradient streams, maximum rel lef is 
about 500-700 feet. 

TEXTURE 3 contained long, narrow valleys with steep slopes and 
depths of about 300-400 feet. Valley streams have medium 
to low gradients. 

From each texture, 3 or 4 samples (subimages) were obtained. The s«ne 
subimages were then s^pled from the 45® and 90® look direction 
simulations. A total of 33 subimages provided the input for this 
experiment (11 sub I mages for each look direction). These sub I mages are 
shown in Figure 8a-c. The specific research questions addressed by this 
experiment were (1) can these three textures be classified using 6L01 
features at any of the three look directions, and (2) can these three 
textures be classified using GLCM features independent of the look 
direction, i.e., are the texture features derived from the same spatial 
structure Independent of the look direction of the sensor, thus, can The 
textures be classified using all three orientations simultaneously. 

For ecch of the 33 sub images described above a 6L(>4 and the 
resulting texture features were calculated for distances of 4, 6, and 10 
at 0®, 45®, 90®, and 135* (these angles )nill be referred to as GLC 

angles as opposed to the look direction angle). It was found Cl33 that 
distances 4 and 10 showed basical iy the same trend as 6 so only the 
distance 6 results will be discussed. Also, it was found that averaging 
the texture features over the GLC angle as was done previously Ql3 
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destroyed our ability to separate textures one and two. This Is 
expected from their spatial structure. Thus only results from 
Individual GLC angles will be presented. The 6LCM texture features were 
analyzed pair-wise as was also done previously CO* 

Analysis of the data qualitatively showed that all three textures 
could be classified at one or two target/ sensor orientations but not at 
all three simultaneously. For example, Figure 9a-c contains the 
scattergrams for the maximum probability and contrast texture features 
at GLC distance 6 and GLC angle of 0**. At a look direction of 0** 
(Figure 9a) none of the three textures can be separated, while at 45" 
(Figure 9b) all three textures can be classified. Analysis of other 
texture pairs shows the same trend, i.e., the textures ctinsidered here 
can be classified for one or two sensor look directions but not at all 
three Cl3]. if the texture samples for each terrain structure from al I 
three look directions are combined it becomes obvious that the textures 
considered here cannot be classified Independent of look direction (see 
Figure lOa-e). 

The purposj of this analysis was to determine the sensitivity that 
GLC^ texture features show to changes in the orientation of the surface 
structut ) relative to the sensor. Radar image simulation was used to 
generate a suitable set of images with the effects of the sensor flight 
path Isolated. Within the limitations of this experiment, I.e., three 
different terrain structures, and three flight directions. It was shown 
that (1) the 6LCM texture features can be used to classify the terrain 
structures at one or two flight directions but not at all three, and (2) 
the 6LCM texture features cannot be used to classify these terrain 
structures Independent of the flight path. The search of the optimum 
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set of sensor parameters for geologic applications Is thus complicated. 
That Is, the results of this study Indicate that the optimum sensor for 
classifying (using either manual or automatic techniques) surface 
structure Is dependent upon the orientation of the structure to the 
flight path of the sensor. Because of tie monostatlstic nature of radar 
Imaging the same surface structure Imaged at two different flight angles 
can (and often do) appear totally dissimilar. A set of sensor 
parameters optimized to detect these structures at one flight angle 
might be totally different if the flight angle were changed. 

V. CX)NCLUSIONS AND RE(XMMENDAT I ONS 

Texture Is an Important characteristic of radar images of rough 
terrain. It was shown that the GL(X derived texture features can be 
used to classify texture. In this paper we have demonstrated that GLOi 
derived texture features are sensitive to both sensor and flight 
parameters. In fact, we lose our ability to classify texture by these 
features if either the radiometric or spatial resolution Is degraded. 
We also found that these texture features are sensitive to the sensor 
flight path. We could classify the surface structure for one or two 
target/ sensor orientations but not for all three considered 
simultaneously. That Is, GLC^ texture features cannot be used to 
classify texture independent of the flight path. 

While general conclusions on the sensitivity of textural features 
to system and flight parameters can be made from the results of this 
study, there Is a need to further refine these conclusions, specifically 
It is recommended that the sensitivity shown here be quantitatively 
studied. Quantitative results are needed to help guide system design 
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and flight planning. Two approaches to obtaining quantitative results 
should be pursued In parallel. First* an analytic study of the 
relationships among surface* sensor and flight parameters and the GLQ4 
Is needed. Second* more radar Images should be analyzed. With more 
data the qualitative discussion of the effects of spatial and 
radiometric resolution can be extended to a quantitative analysis* for 
example plots of the 'variance* of each cluster as a function of 
resolution could then be studied. The ultimate goal of such an analysis 
would be an expression for the sensitivity of each texture feature as a 
function of resolution. This study also dealt with only radical changes 
in the flight direction over a fixed site. Further analysis is now 
needed to determine the effect of small angle changes* e.g.* on the 
order of 5*. Also this study only considered one angle of Incidence. 
It would be Interesting to determine if there exist some Incidence angle 
for which we could classify surface structure Independent of the flight 
angle. 
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(a) Maximum Probability/Contrast 
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Figure 10^ Scatter Diagrams for Texture Feature Pairs 
Combining all Flight Paths. 
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GEOLOGY 

TOPOGRAPHY 

^5 

Rocks of the Lower 
Pennsy 1 van i an Consisting of 
Alternating Beds of Sand- 
stone and Shale with a Few 
Beds of Coal. 

Mountains and Ridges with Steep 
Slopes and a Maximum Relief of 
of About 1500 Feet. 

1 

Rocks of the Lower to 
Middle Ordovician Consis- 
ting Primarily of Dolomite 
and Cherty Dolomite with 
Some Beds of Limestone, 
Shale, and Sandstone. 

Rolling Hills and Several Ridges 
with a Maximum Relief of 
200-300 Feet. 

1 

See T^ 

Area of Overall Low Relief but 
with Many Small Hi Ms that are 
Separated by Several Creeks and 
Streams . 

^3 

Central Region (See T^) 
Flanked on Either Side by 
Rocks of the Upper Part 
of the Middle Cambrian in 
Beds of Dolomite, Lime- 
stone, and Slate. 

Rolling Hills and Elongated 
Ridges Separated by a Trellis 
Drainage Pattern and Having a 
Maximum Relief of About 500 
Feet . 

^2 

Rocks of the Upper Pre- 
Cambrian Consisting 
Primarily of Metasediments. 

Mountains and Hills with Steep 
Slopes and a Maximum Relief of 
About 1000 Feet. 


Table 1 

Geology and Topography of the Tennessee Test Area. 
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ASPECTS OF SIMULATION FOR RECTIFICATION STUDIES 

INTRODUCTION 

RECTIFICATION = GROUND Position of Pixel Center 
Given Pixel Row, Column 

NEED: 1. Satellite Position 

2. Direction of Imaging (optical) Axis 

3. Internal Geometry of Sensor 
Atmospheric Conditions 

1. From Satellite Tracking 

2. From Attitude Sensors 

3. From Calibration 
Neglected 

NOT SUFFICIENT FOR SUB-PIXEL ACCURACY 
ALTERNATIVE PARAMETER MODELING AND ESTIMATION 
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FIGURE 1. GROUND POSITIONS OF PIXELS 

• PIXEL CENTER GROUND POSITION 

* OTHER POINT 

HEAVY LINES ARE PIXEL BOUNDARIES 
DOTTED LINES SHOW INTERPOLATION FOR POSITION 
OF A POINT 
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FACTORS AFFECTING RECTIFICATION ACCURACY 


SENSOR RELATED 

SCAN NON-LINEARITY 
SCAN CORRECTOR NON-LINEARITY (TM) 
BAND-TO-BAND OFFSETS 
TIMING ERRORS 

PLATFORM ORIENTATION 
EPHEMERIS 
ATTITUDE 

EARTH RELATED FACTORS 
EARTH SHAPE 
EARTH ROTATION 

ATMOSPHERIC REFRACTION (NEGLIGIBLE?) 

GCP'S 

ACCURACY 

DENSITY 

DISTRIBUTION 
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METHODS OF RECTIFICATION 


INTERPOLATIVE APPROACH 

ARBITRARY MATHEMATICAL FUNCTION RELATING IMAGE 
COORDINATES TO RECTIFIED (GROUND) COORDINATES 

NO SENSOR/PLATFORM MODELING 

PARAMETRIC APPROACH 

ATTEMPT AT EFFECTIVE GEOMETRIC MODELING OF 
IMAGING PROCESS 

PROPER USE OF A-PRIORI INFORMATION 

STUDY Or ERRORS AND THEIR EFFECTS IS POSSIBLE 
THROUGH SIMIJLATION 
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INTERPOLATIVE APPROACH TO RECTIFICATI0N/RE6ISTRATI0N 
TYPES 

. GENERAL TRANSFORMATION 

+ A-PARAMETER ORTHOGONAL 
6-PARAMETER AFFINE 
+ HIGHER ORDER POLYNOMIAL 
+ HARMONIC SERIES 
MOVING AVERAGES 

+ WEIGHTED MEAN 
MESHWISE LINEAR 

LINEAR LEAST SQUARES PREDICTION 
FINITE ELEMENT METHODS 
SPLINES 

CHARACTERISTICS 

CONTROL POINTS NECESSARY 
NO SENSOR/PLATFORM MODELLING 
A-PRIORI INFORiWION NOT USED 
ERROR CAUSES AND INTERACTION NOT STUDIED 
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PARAMETRIC APPROACH TO RECTIFICATION 

PRESENT IMPLEMENTATION 

SENSOR GEOMETRY CORRECTION 
EARTH RELATED SYSTEMATIC ERRORS CORRECTION 
EPHEMERIS AND ATTITUDE DATA EXPLOITATION 
PLATFORM ORIENTATION ESTIMATION USING GCP'S 
INTERMEDIATE PIXEL POSITION COMPUTATION 

PLATFORM ORIENTATION ESTIMATION 
FIXED MODEL 
RANDOM MODEL 

CHARACTERISTICS 

SENSOR/PLATFORM MODELLING NECESSARY 

CONTROL POINTS NOT USED SOMETIMES 

PIXEL ELEVATION ASSUMED KNOWN (SINGLE COVERAGE) 

GROUND GEOMETRIC CONSTRAINTS NOT EXPLOITED 
SENSOR/PLATFORM MODELLING INCOMPLETE 
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fUCTC S,RAyMBTR!C APPKCACH 

PROPOSED LANDSAT MSS/TM FRAME RECTIFICATION 


PROBLEM 

RECOVERY OF PIXEL GROUND POSITION FROM SINGLE MSS/TM 
. FRAME 

APPROACH 

. PARAMETRIC 

MODEL 

COLL I NEAR I TY 

IMPLEMENTATION 

SENSOR GEOMETRY CORRECTION 

PLATFORM ORIENTATION ESTIMATION USING GCP'S 

INTERMEDIATE PIXEL POSITION COMPUTATION 

CHARACTERISTICS 

SMALLER ANGULAR COVERAGE 

BENIGN SPACE ENVIRONMENT 

MORE COMPREHENSIVE SENSOR/PLATFORM MODEL 

IMPLICIT CORRECTION OF EARTH RELATED SYSTEMATIC ERRORS 


ORtuiMnL PA<^E 

OF POOR quality 


MIKHAIL/PADERES 



ORIGINAL PAGE ISI 

OF POOR QUALrry 

IMAGING EQUATIONS 


x" 


U-Uj 


”11 *^12 


■ U-Uj‘ 

Y 

= S M 

V-V3 

= S 

^21 ^22 ^23 


V-V, 

W> 

Z 


W-Ws 


”31 '’32 ”33. 


_W-W5_ 


[X Y Z] = IMAGE COORDINATES OF A POINT 

I U V Wj = COORDINATES OF CORRESPONDING GROUND POINT 

[Ug Vg Wg] ^ = SATELLITE COORDINATES AT INSTANT OF 

POINT IMAGING IN GROUND COORDINATE 
SYSTEM 

M = ROTATION MATRIX V«HICH BRINGS GROUND COORDINATE 
SYS I EM PARALLEL TO IMAGE COORDINATE SYSTEM 

s = SCALE FACTOR; VARIES FROM POINT TO POINT 


MIKHAIL/PADERES 
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> Y - - 


FIGURE 2. INTERNAL GEOMETRY OF SCANNING TYPE 
SENSOR 

P - A POINT ON IMAGE FRAME 
P' - ITS PROJECTION ON A PLANE TANGENT TO 
CENTER LINE 

C - PRINCIPAL DISTANCE OF SENSOR LENS 


MIKHAIL/PADERES 
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COLLINEARITY EQUATIONS FOR SIMULATION 


U'Ug ^11 ^ ^ ^21 ^ ^ ^31 ^ 

W“Wg ^13 ^ ^23 ^ ^ '^33 ^ 

V“Vg Mj2 ^ ^ 2.2 ^ ^32 ^ 

W~Wg ^31 ^ ^ ^32 T ^ ^33 ^ 

[u V w] ''’ - DEFINED IN RECTANGULAR COORDINATE SYSTEM 

[o X h] - DEFINED IN GEOGRAPHIC COC UNATE SYSTEM: 
■H, LATITUDE; x, LONGITUr ; H, ELEVATION 

FOR SIMULATION 

+ ONLY [u V w] ^ UNKNOWN IN COLLINEARITY 
EQUATION 

+ TRANSFORM [u V w] ''' [♦, x, h] ^ 

+ ASSIGN VALUE TO H 
+ SOLVE FOR X 


MIKHAIL/ PADERES 
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SYNTHETIC DATA 


ORIGINAL Phm III 

OF POOR QUA' 


GENERATION 

MODEL: SATELLITE COLLI NEAR I TY EQUATION 
EXPLOIT A-PRIORI KNOWLEDGE OF PARAMETERS 
FRAMES WITH DIFFERENT PERTURBATIONS . 

VALIDATION PROCEDURE 

SELECT REAL IMAGE WITH MANY SUITABLE FEATURES FOR GCP'S 
IDENTIFY GCP'S 

DIVIDE GCP'S INTO TWO GROUPS 

RECTIFY IMAGE USING FIRST GCP GROUP 

COMPUTE MSE USING SECOND GCP GROUP 

REPEAT USING SYNTHETIC IMAGE SIMILAR GCP CONFIGURATION 

COMPARE MSE'S 
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^11 ■*■ ^12 ■*■ ^13 

M32 (U-U3) + M32 (V’Vg) + M33 (W-Wg) 

M22 (U-Ug) + M22 (V-Vg) + M23 (W-Wg) 

M32 (U-Ug) + M32 (V-Vg) M33 (W-Wg) 


[x Y zj ^ AND [u V w] ^ KNOWN (CONTROL POINTS) 

PARAMETERS DEFINING ROTATION MATRIX AND [Ug Vg Wg]^ 
UNKNOWN 

GIVEN ENOUGH CONTROL POINT PARAMETERS SOLVED FOR BY 
LEAST SQUARES 


MIKHAIL/PADERES 
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Image Matching Using Hough Transforms 


Larry S. Davis 
and 

Azriel Rosenfeld 

Computer Vision Lab 
University of Maryland 
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HQiKti Transforni TechnlauM 
- Efficient catching procedures 
1) Line dstecticn 

- find ssts of colliheor feoture oolntt frea the set 

l» • {(»jY|)i 

- Lino representation 

* - U cos • +Y sin e 



- Colllicer points lie on o line ef eortlculor (»<•) 


original FAG£ iSI 

OF POOR QUALITY 

Hough transfoni - orroy of occunilotors 

■ niflter of points In P Mhich lie on the line 
» • Xcos* * Ysln« 

For each OCY) < P do 

For • • 0<2«.d* do 
begin 

* ■ Xcose * Ysin* 

* 1 
end 

- Peaks In correspond to large sets of colllneor points 
19)1 le larcsst (H) > t do 
l^gln 

Rork largest (H) as a llnej 
for each (X,Y) < P which lies on largest (N) do 
for • • 0<2«.d* do 
begin 

p ■ Xcos* * Ysin* 

H(*.») - H<*,») - 1 


"9 » 
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?.> Circles (Eollord and Sklonsky) 

(X-h)2 ♦ (Y-k)2 - 

- ossuse you knoM r 

• ttont to find (h<k) ' 

For ecth (X<Y) € p do 

For • • 0/2«<d« do 
begin 

h ■ X ♦ r cos • 

* 

k • y ♦ r Sin • 
N(h.lc) - H(h#k) ♦ 1 
end 




V 
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3e Arbitrary Shapes (Bollard/ Dovls and Yon) 


t 





((X|/Y|)> 


fl 

1-1 


a. Position invarlont mtching (Sklonslcy) 

For eoch (XvY) < P do 

for each < B(S) do 

H(X^sX/Y^AY) - H(X^aX/Y^aY) ♦ 1 


( 1 ) 





For oocii (X^Y) in r 

FOr each UX<*Y) tn B(S) 
H<X-iX,Y-*Y) • H(X-*X>Y- 

AleorttlD (1) - •(■•n) operations 


AleorltMi <2) - o(rsH) operations 
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b. Rototlon invariant lotchln] 

- only the monltutfe of the vectors in I con be med 

For eoch (X<Y) < P do 

For each («x<«Y) c B(S) do 
For • • 0<2«,d* do 
begin 

X’ • X «X cot • 

Y* - Y ♦ *Y sin • 

H<X',Y') • H<X',Y') ♦ 1 
efxl 

• each oalr <(K/Y)/ (ax,*Y)> it uied to point out o circle 


in H. 


0WG1N^'»- 3 

OP POOR QUAUiTY 

c. Scale Invariant mtchlng (S|^$ 2 } 

For eoch (X,Y) c p . 

For each (aX^ay) < B(S) 

For S - S1.S2 .aS 
begin 

X' - X ♦ S AX 
Y' - Y ♦ S .1 
H(X'.Y') - H(X'.Y') ♦ 1 


end 
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Subpixel Registration Accuracy 
and Modelling 


Laveen N. Kanal 
LNK Corporation 
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INTRODUCTION 


• HOH ACCURATELY CAN A LANDSAT IMAGE BE REGISTERED 
TO A REFERENCE IMAGE? 

• HOW CAN SUBPIXEL ACCURACY BE ACHIEVED? 

• WHAT FACTORS AFFECT REGISTRATION ACCURACY? 

• HOW SHOULD THE REFERENCE IMAGES BE FORMED? 

• HOH CAN VARIOUS ALGORITHMS BE EVALUATED? 
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ORIGINAL PAGE IS 
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HIGH REGISTRATION ACCURACY 


t Needed to merge data from different sources 


- Mult I temporal data 


- Multi SENSOR data 


• Misregistration results in reduced 

CLASSIFICATION ACCURACY 
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• Less than .5 pixel geodetic registration 

ERROR 

• .3 PIXEL REUTIVE (BETWEEN TWO IMAGES) 

Above standards must be met 90Z of the time. 
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CURRENT REGISTRATION APPROACH 

• Develop Control Point Chip library (CPC) • 
- CPC-SET OF recognizable POINTS 

0 Extract Control Point Neighborhood (CPN) 

FROM SCENE TO BE REGISTERED 

• Find best location in CPN matching CFC 
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SUBPIXEL REGISTRATION ACCURACY 

Basic Problem: Find a translation alipning a reference 

(Ground Control Chip) cmd a Landsat image 
to less that one pixel 



Ground Control 
Chip 

32 
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SUBPIXEL ACCURACY PROBLEMS 

1) WHAT IS SUBPIXEL ACCURACY? 

Image distortion is nonlinear. 

MEASURE OF ACCURACY? Maximum error^ average error, 
percentage of points lying far away? 

2) HOW CAN CLAIMS FOR SUBPIXEL ACCURACY OF ALGORITHM 
BE ASSESSED? 

• Experimental methods 

• Analytical methods 

- Probabilistic image models for correlation 
procedures 

- Geometric models for feature (edge) matching 

- Assume error bounds on feature detection 

- Compute bounds on estimation of edge 
location 
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PROBLEflS (Cont'd.) 


ORIGIiMAL PAQIi 
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3) WHAT SCENE PROPERTIES SHOULD BE USED TO SELECT 
GROUND CONTROL CHIPS FOR AN IMAGE? 

^) HOW SHOULD THE LANDSAT IMAGE BE PROCESSED TO FORM 
AN Umt SUITABLE FOR MATCHING? 

• Edge enhanced image 

• Edge image 

• Isolated significant point image 


Corners 

Intersections 

High curvature points 
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CLASSICAL CORRELATION 




Can be anplled to Landsat image^ edge enhanced image^ 
binary Image^ etc. 



Image 1 


Image 2 


Correlation 
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BASIC SUBPIXEL REGISTRATION APROACH 

• Find the cross-correlation between a 
CPC AND THE CORRESPONDING CPN 

• Interpolate the correlation function 

TO FIND THE CONTiNUOUS CORRELATK^ SURFACE 
PEAK 


CPC AND CPN MAY BE PREPROCESSED TO IMPROVE 
CORRELATION ACCURACY. 
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UKfUiii^;:tL FA4>£ sS 

OF POOR QUALITY 

INTERPOLATION FOR SUBPIXEL 
ACCURACY 

1) Fit surface to correlation function In a neighborhood. 

• 5x5 neighborhood 1$ common 

• Up to the Ath order bivariate polynomials are 
used 

• Successive orders can be used/ use RMS residual 
error to select order 

• Elliptical cones have been used 

PROBLEM: 


Sensitivity of ‘peak location to fitting function 
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INTERPOLATION (Cont'd.) 


2) Use centroid of correlation function in a neighborhood 

3) Spatial offset corresponds to non-vanishing phase 
in frequency domain 

• Transform phase portion of correlation back to 
spatial domain to locate peak 

PROBLEM ; 

Non symmetry of cross-correlation function about 
peak causes error in phase 
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ESTIMATING CORRELATION PEAK 
UNCERTAINTY 

1) Curvature at peak 

2) Second moment of correlation samples around peak 

3) Rate of decline away from peak 

USES OF MEASURES: 

• Reject Matching 

• Weight for mapping furiction fit. 



( 

i 

I 
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FEATURE IfiAGE MATCHING 

FEATURES 

EDGES 

INTERSECTION 

HIGH CURVATURE POINTS 

• Feature matching is growing In popularity 
a Robustness under spectral change 

- Crop growth 

- Water content 

- Illumination 
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METHODS OF FEATURE MATCHING 

• Correlation of Edge Images 

• Correlation of Binory Edge Imaaes 

• Lineals Correspondence (L.N.K. procedure) 

- Real lineals 

- Abstract vectors 

• Point Matching 

- Relaxation 


% 
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LITERATURE INTRODUCTIOI^ 


• Review five previous studies of Landsat registration 

ACCURACY 

• Common flaw - reference image assumed highly accurate 

• Some sources of reference image accuracy 

1) Polynomial fitting on enlarging reference image to 
MATCH map 

2) Fitting polynomial to determine attitude and 
altitude correction 

• Combined error effects estimated accuracy k pixels 

- 90% OF ALL points HAD POSITIONAL ERROR WITHIN 23 
METERS (NiBLACK 1981) 

- Basis for above not adequately described in paper, 
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DEPARTURE FROM PREVIOUS EXPERIMENTS 


• Previous theoretical and simulation studies of 

REGISTRATION ACCURACY MEASURE PERFORMANCE IN ONE 
OF TWO ways: 

(1) Single offset probability of false acquisition 
TO determine accuracy to nearest pixel^ and 

(2) Either expected value of the error or root 

MEAN SQUARE OF THE ERRO<’ TO MEASURE SUBPIXEL 
ACCURACY. 

• We propose to REPLACE THE ABOVE BY THE FOLLOWING: 

(1) Probability of false acquisition over the entire 
image, and 

(2) The probability distribution of the error. 
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EXPERIMENTAL REGISTRATION 


PURPOSE - DETERMINE FEASIBILITY AND EXTENT OF SUBPIXEL 
ACCURACY OF EDGE LOCATION UNDER IDEAL CIRCUM- 
STANCES. 


METHOD: 


GENERATE A REFERENCE IMAGE CONSISTING OF TWO 
HOMOGENEOUS r^EGIONS 



- 9 IS A PARAMETER 

- The TWO regions have different means and 

I.I.D. pixels 

- Sensor image consists of a subpoint of the 

REFERENCE IMAGE WITH NOISE ADDED 

- Grey level correlation used to match images 

- Fourth-order bivariate polynomial fit to 

CORRELATION IN A 5x5 NEIGHBORHOOD 

- Peak taken as match point 


NOTE: No translation was introduced. Effect of noise on 


offset was DESIRED. 
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EXPERIMtNTAL RESULTS 


OUTCOME: 

• Correlation function turned out to be 
ALMOST circularly SYMMETRIC 

t Estimated peak always near center of pixel 

• Peak is estimate of where corner lies within pixel 

• True corner was often near pixel boundary 

• Subpixel accuracy was poor 

• Window size (225 pixels) was large enough to make 
Law of Large numbers applicable 

t Numerator and denominator of correlation function 

CHANGE LITTLE IN NEIGHBORHOOD OF CORRECT MATCH POINT, 
THUS EXPLAINING SYMMETRY 

• Future experiments will assume noise points are 

CORP.ELATED AND REFERENCE POINTS ARE CORRELATED 

(not independent) 

• This WILL alleviate the above problems and make 
simulations MORE REALISTIC. 
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COMPARISON OF OUR SIMULATIONS WITH 
NOVAK'S 


• Novak's work did better than ours since he only 
CONSIDERED A SMALL STRIP AROUND THE EDGE 

“ Here a pixel shift in the template causes a 

LARGE DIFFERENCE IN THE STATISTIC 

• Combination of Novak's simulation and ours gives 

INSIGHT INTO MATCHING PROBLEM 

- Maximum likelihood makes most efficient use of 

DATA 

- From this viewpoint Novak method poor for finding 
EDGE to nearest PIXEL 

- One should use full control chip since maximum 

LIKELIHOOD ESTIMATE USES ALL PIXELS. 

0 SuBPiXEu Accuracy 

- Maximum likelihood for subpixel accuracy uses only 

EDGE PIXELS 

- Other pixels add no information - only cause further 
error 

- Novak's method superior here 
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COMPARISON WIIH NOVAK'S METHOD (cont'd.) 


• Conclusion (tentative) 

- Perform correlation on whole control chip to 
GET PIXEL accuracy 

- Only use pixels with a high likelihood of sub- 
pixel information (E.G./ on or near edges) for 
SUBPIXEL matching. 
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MOSTAFAVI - SMITH MODEL 


if = p(x) + rip(x) 
Ig = P(j(x) + rigCx) 
Pc|(x) = p(Ax + Xq) 


ORIGINAL PAGE m 
OF POOR QUALITY 


X = (xj^X 2 )' point in plane 
A: 2x2 distortion matrix 


P: noise free imane either a deterministic 

or a random signal 


For p deterministic, p(x), p^jix) or their Fourier 
Transforms available. Forp random: signal spectrum 
assumed known p, rip, ng zero mean, 2nd order, inde- 
pendent Gaussian Processes with spatially invariant 
statistics. 
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MOSTAPAVT-SMITII MODl?:L FOR RRGISTRATION 

GOAL: Find imaqe size nnd shaf>o minimizinq probnbilitv' 

of false acquisition and ma x i mi z i iui local accuracy. 

MEASURES OF CORRELATOR PERFORMANCE 

1. Ratio of mean cross-correlation peak to 
standard deviation of cross-correlation in the 
sidelobes (called Peak-to-S idelobe Ratio) . 

2. Probability that the correlation lainction 

of some point far from the correct reqistrat ion 
exceeds some threshold. (called the sinqlo- 
offset probability of false acquisition.) 

3. First order approximation to local reqistrat ion 
error using the correlation function gradient and 
curvature . 

MASIC ASSUMPTIONS: Gaussain images, additive Gaussian 

noise, the two images to bo registered are ro1atf*d 
by an affine transformation. 

l^ESUI.TS 1) Dorive.s imaqe size to minimize probability 
of false acquisition under geometric distortion. 

2) Derives expression for minimum achievable 
probability of false acquistion. 

3) For circularly symmmetric autocorrelation 
functions, the square window is optimal among rec- 
tangle windows. 

4 ) Deri vos opt i ma 1 wi ndnw s i zo t<’i max i in i ze 1 oca 1 
accuracy . 

5) For a fixed geometric distortion the imago size 
resulting in minimum local error is smaller than the 
size giving a minimum probability of false acqui.si tion. 
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FUNDAMENTAL ASSUMPTIONS 
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Mostafavi-Smith (1978) 

1 
I 

I 

Reference image I^(x) spatially stationary* 

Sensed image 13 ( 2 ^) 

IgCx) =* lp(9+x) + ** 

NOISE independent OF 
Ip, Gaussian 

* STATISTICS spatially SHI FT- INVAR I ANT 

I 

** ADDITIVE NOISE UNREALISTIC ESPECIALLY FOR PREPROCESSED OR 
EDGE-ENHANCED OR BINARY PICTURES 

*** SINCE WEAK ASSUMPTIONS ON Ip, Ig GUARANTEE THE CORREUTION 
PROCESS C(x) AT VARIOUS OFFSETS JC IS ESSENTIALLY GAUSSIAN 
FOR LARGE WINDOWS (SENSED IMAGES). 


Comments 

RETAINED ONLY TRANSLATIONS, 
NOT DISTORTIONS, CONSIDERED 
NOW 

Need only Ip, I 5 jointly 

STATIONARY ALTHOUGH 
INDEPENDENT CASE IS 

simplest; not needed at 
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DEF I N I T I ONS original U 

OF POOR QUALITY 


D(k) = E [C(!t)] 

Picture of one-dimensional case 


D(x) "known" for X * o> ±h, +2h/"‘ h = pixel width 



0* = ESTIMATED (FROM C(’)) MAXIMUM LOCATION 

Figure of merit^*^^ Q(t) = Pr |^|0*-e|>Tj 

(+) NOTE DISTINCTION FROM SINGLE-OFFSET COMPARISONS LIKE 
Pr(C(^)^ C(xj FOR VARIOUS X, AS USED BY MoSTAFAVI -SmI TH (1978) 
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If D(x) is known at 

0/tH/ . . . ^ 

AND IF OBSERVED PIXEL GREY-LEVEL IS 

2 , (k+1)h 

Xk = H / 

(or any other LINEARY OPERATOR OF I 5) 

WITH REFERENCE-IMAGE PIXEL GREY-LEVEL 

Yj = R / Ir(t)dt 

JH 

Then a right upper bound on the error as a fraction of a 
PIXEL is 

, / h2d('''>(0)A 
V-12D"(0) ' 

Qualitative meaning and interpretation of K; 

(a) if D(x) is known at integer multiples of Hi then 

TREATING D(*) AS QUADRATIC ON PIXEL CONTAINING 0 GIVES 
ERROR AT MOST FRACTION K OF PIXEL. 

(b) If Ip IS HIGHLY OSCILLATORY WITH RESPECT TO UNIT OF 
LENGTH H WITH CORRELATIONS OF Ip' FALLING OFF RAPIDLY 


THEN K IS LARGE. 
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EDGi SUBPIX EL ACCURACY 


ORlGUMal I : 
Of POOR QUALITY 


• Assume relatively high correlation accuracy 
vwithin a pixel or two) 


« Locate edge in image known to correspond to 
straight features 


• Estimate location of line in mixed pixels 
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ESTIMATION PROCEDURES (Davis) 


ORIGINAL FAGS IB' 
OF POOR QUALITY 


1) Make distributional assumntions for bordering 


regions. 

• Estimate mixed pixel values for each possible 
location of line 

t Use optimization to pick line best fitting arey 
level data 


2) Find best line fitting pixels ignoring grey levels 
Example: Fit line throuoh centers 
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GEOMETRIC ACCURACY 
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BASIC QUESTIONS: 

• How ACCURACTELY CAN WE LOCATE REAL WORLD 
EDGES AND STRIPS GIVEN OBSERVED DIGITAL 
EDGES AND STRIPS? 

• How CAN THIS ACCURACY INFORMATION BE USED 
TO ACHIEVE SUBPIXEL ACCURACY? 

• HhAT PROPERTIES OF LINES OR STRIPS CAN BE 
USED TO SELECT GOOD FEATURES FOR A REFERENCE 
IMAGE? 
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TYPES OF OBSERVED EDGES 
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1) Digital edge - the set of pixels a real edge 

INTERSECTS 

• SIMPLEST MODEL til UNREALISTIC 

2) Digital edge (pixels hissing) - any subset of a digital 

EDGE 

t FEASIBLE MODEL IF WE ONLY SELECT GOOD CANDIDATES 
FOR EDGE 01 NTS 

3) Digital edgl (pixels missing, pixels added) - a digital 

EDGE WITH SOME PIXELS MISSING AND SOME SPURIOUS EDGE 
PIXELS ADDED 


f REALISTIC MODEL 
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DOMAIN OF VARIABILITY 


original PAGt: ‘ 
OF POOR QGA * • 


The set of observed edge pixels resulting from a 

REAL EDGE COULD COME FROM AN INFINITE NUMBER OF EDGii'S. 



a-REAL EDGE 


PROBLEM: How can we parametrize the possible lines 

CAUSING these EDGE PIXELS TO BE OBSERVED? 
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SLOPE 


DIGITAL LINE DESCRIPTION 

(Dorse and Smeulders) 


original PA2- 

op POOR QUALsIY 


Digital lines will be characterized by four parameters 
Eight connected lines are used 


Chain code 



Cha incode 0100 


PRESENT IN STRING 
R - NUMBER OF CODES PER PERIOD 
- S “ STARTING POINT OF SEGMENT WITH STANDARD PERIOD 








01 

0 


0 


Four parameters: 

- N - LENGTH OF CHAIN CODE 
Q “ SMALLEST PERIODICITY 
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FEASIBLE PARAMETER REGION 
DIGITAL EDGE 

Parametrization of real lines 


ORIGINAL PAGE IS 
OF POOR QUALITY 



§ Given a digital edge, the set of all lines which 

COULD GIVE rise TO THE EDGE CAN BE PARAMETRIZED 
IN TERMS OF (C,a) 

t Feasible region is a quadrilateral 

• Vertices can be expressed in closed form in terms 
OF (N,q,p,s) 
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FEASIBLE PARAMETER REGION 
DIGITAL EDGE FORMULA 


ORIGIN^**- 

OF POOR QUALITY 


Dorst and Smeulders ( 1982 ) 


If one d<‘finrs functions F and L by: 

F(s) • s -I "j *) 

N — 

I-(') - s *t -- J q 

q ^ 

and an intc|t*'t f by the inplirit definition 

I ♦ I - ■ i. and 0 t q 

^ q' q q ^ 

THEN THE CORNERS A/B^C AND D OF A DOMAIN IN "COORD I NATES 

ARE GIVEN BY: 


rpioEl - r(a)Ei 

1 q 1 q« 


- F(.)t 

•1 > 

♦[F(sef)|]-F(s4f)t 

•5 > 

♦[Fia*/)|j -F(a*f)fc 



where 


q4» Lfe*/) - F(e) , - (pq^^D/q 

q-» L(s) - F(s«t) , p_ • (pq-“l)/q 
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ORIGINAL PAGE 
OF POOR QUALITY 


FEASIBLE PARAMETER 
REGION 

DIGITAL EDGE - PIXELS MISSING 
FOR SIMPLICITY ASSUME Oi slope v< 1 



0 Each feasible line intersections diagonal line with slope -1 

THROUGH SELECTED PIXELS 

e Select distances along diagonal in leftmost and rightmost 

PIXELS as PARAMETiRS OF LINE 

0 Each intermediary diagonal gives rise to at most two linear 

INEQUALITIES RESTRICTING THE FEASIBLE REGION 

0 Feasible region is a polygon in the (a,b) plane 
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FEASIBLE PARAMETER REGION 
DIGITAL EDGE - PIXELS MISSING, PIXELS ADDED 


• Each subset of pixels through which a line can pass 

GIVES RISE TO A CONVEX POLYGON 

0 Feasible region is union of these polygons 

• Combinatorial problems make one of the following restrictions 
desirable 

1 ) FEW WRONG PIXELS ADDED 

OR 2 ) FEW PIXELS TOTAL 

OR 3 ) APPROXIMATION OF FEASIBLE REGIONS 

0 Careful thresholding and edge checking may help achieve 
the first two restrictions 

0 Approximation of feasible region 

~ Fit least square line through edge points 

- Discard pixels not on fitted line 

- Apply analysis of case where no pixels are added 

- If necessary perturb the line and repeat the process 

§ Weight polygons by the number of corresponding edge points 
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FEASIBLE PARAf€TER REGION 


ORIGINAL PAGE 19 
OF POOR QUALITY 


Digital Edge 

Feasible region-quadrilateral 



Digital edge (pixels missing) 

” Assume n pixels given 
- Feasible region convex polygon with at most 
2n sides 

B 

u A 




VARIATION MEASURES 


ORIGINAL hAC; : 1^1’ 
OF POOR QUAU1*Y 


Y VARIATION GIVEN X 



X VARIATION GIVEN Y IS DEFINED SIMILARLY 
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VARIATION MEASURES (cont'd) 


original page is 

OF POOR QUALIFY 


Parametrize each feasible line segment to have 

UNIT LENGTH 



Define variation function V: 

BY V(T) = MAXIMUM DISTANCE BETWEEN FEASIBLE 
LINESi MEASURED T UNITS DOWN EACH 
LINE. 



0 



VARIATION MEASURES (cont'd.) 


Variance of y given x 
Variance of x given y 


Variance of point t units down each line 
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ORIGINAL PAGE IS 
OF POOR QUALITY 

DISTRIBUTIONS ON LINES 

« Many distributions on lines are feasible 

• Uniform distribution depends upon the 

PARAMETRIZATION 

• Invariance under rotation and translation singles 
OUT A distribution: 

Uniform distribution in (p^6) 



where the distribution is over all lines 
passing through a given bounded I cure 




STATISTICS OF Y-VARIATION 


• Let Xq be fixed 

• Find the mean and variance of the y values of 
THE feasible LINES AT Xq 

• Find A confidence interval for the y-coordinate 
BEING within A SPECIFIED DISTANCE FROM THE MEAN 

• Mean and variance can be calculated easily 

NUMERICALLY 

t We are working on confidence intervals 
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VARIATION GOALS 

1) Derive bounds for each variation measure 

AS A FUNCTION OF DIGITAL EDGE PARAMETERS 

2) Compute the mean and variation of each variation 

MEASURE 

3) Find the x^y or f value which minimizes the 

CORRESPONDING VARIATION MEASURE 

4) Find good digital edge characteristics^ e.g.^ 

SLOPE which can BE USEF TO MINIMIZE VARIATION 
MEASURES 




OR!C!NAl fS 
OF POOR QUALITY 
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ANGLES 


Assume we have two real line segments sharing an 

END POINT 



0 How CAN WE USE THIS KNOWLEDGE TO REFINE OUR ESTIMATION 
OF POSITIONS? 


0 What angles are best for estimation? 

0 What can be done if the line segments don't intersect? 


j ^ M . Jk 


^ * J ^ 


154 


ANGLE CONSTRAINTS 


ORIGINAL PAGE W 
OF POOR QUALITY 


Assume we observe the digital edges resulting from a 
REAL angle. 

We GET A feasible region for each real line segment; 



• A feasible angle is a pair of points one in each feasible 
region 

• Common vertex implies both point lie on same vertical line 

• Fixed angle implies distance between two points is 
constant 

• Leto<q denote this distance 

• FeASIBIE region = there exists a point 

with 


i-uk: . 
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ERROR BOUNDS ON POINT MATCHING 


§ Each edge gives rise to a point to be matched with a 

POINT IN THE REFERENCE IMAGE 

• What can be said about the accuracy of the estimated 

TRANSFORMATION GIVEN THE BOUNDS OR STATISTICS OF THE 
individual POINT LOCATION ACCURACIES? 

0 Work on this problem will be performed when we have 

FINISHED our ESTIMATES FOR THE POINT ACCURACY WITH DIGITAL 
EDGES (pixels MISSING) 

0 Final result: 

Error bounds on transformation accuracy given 


observed edges 
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PROGRESS AND FUTURE WORK quality 


EXPERIMENTAL CORRELATION STUDIES: 

• Simulation results indicate that correlation 

AND SURFACE FITTING TO ATTAIN SUBPIXEL ACCURACY 
SHOULD BE BASED ON PIXELS LIKELY TO CARRY SUB- 
STANTIAL SUBPIXEL INFORMATION (NEAR EDGEs). 

• Future simulations will be more realistic 

AND WILL STUDY THE ABOVE PHENOMENON IN MORE 
DETAIL. 

ANALYTIC STUDY OF PROBABILISTIC SUBPIXEL ACCURACY: 

• Two models were DEVELOPED 

1) Error effect due to quantization when 

REFERENCE IMAGE IS RANDOM 

2) Error effect with deterministic image 
(known shape) DUE TO FITTING ERROR 

GEOMETRIC ERROR ANALYSIS; 

• Feasible parameter regions for lines passing 
through sets of pixels have been obtained 

f Expressions for maximum x.y variation and 
means and variances have been developed. 



PROGRESS AND FUTURE WORK (cont'd. 


GEOMETRIC ERROR ANALYSIS (cont'd. 

• Constraints on feasible regions imposed by 

ANGLES HAVE BEEN DERIVED 

• Evaluation of the above estimates to derive 
optimal features and quality measures of 

FEATURES ARE UNDERWAY 

• We are currently attempting to derive a 

FORMULA FOR THE FEASIBLE REGION IN A DIGITAL 
EDGE WITH PIXELS MISSED 

• The EFFECTS OF THE ABOVE ESTIMATES OF POINT 
LOCATION ACCURACY ON REGISTRATION TRANSFORMATION 
ACCURACY WILL BE STUDIED 

• Effects of geometric distortion on the above 

ANALYSIS WILL BE STUDIED. 
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ORIGINAL PAGE IS 
OF POOR QUALITY 


Improving Spatial Modelling 
in Remote Sensing 


Hunter College: U. C. Santa Barbara: 

A. H. Strahler >1 R. Tobler 

C. E. Woodcock 

Assisted by R. ’rish 


PRECEDING PAGE BLANK NOT FILMED 
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SIP'ATIAI. 



AGRICULTURAL IMAGE 


ORIGINAL PAGE IS 
OF POOR QUALITY 



SPATIAL RESOLUTION 
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APPROACHES TO IMAGE REGISTRATION AND SEGMENTATION 


Grahmme Smith 


188 

Image>to-Image Correspondence 


different viewing conditions 
different resdutions, spectral responses 
temporal changes 
Approach 

• Detect easily recognized / physically meaningful structures 

• Label structures 

• Build description of structure 

• Match descriptions - rough camera model 

• Select feature points 

• Predict how the feature points appev in image 

• Match feature points - precise transform 
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Image Segmentation 

recover scene entities 

- single land cover class 

- no internal boundaries 

• Recover surface shape 

• Initial classification 

• P/dge / Linear structure detection 

• 'Convergence of Evidence’ decision making 
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Detection of Linear Structuree 

tw&-fold purpose: imsfe regisIraiioB Md class booidary detection 
AlgorUbm 

Peak and trough method 
Finds ridge lines (skeleton) 

Uses local and global nature ot intensity peak 



ORIGINAL PAGS SS 
OF POOR QUALITY 

Initial Segmentation 

- based on the reflectance 

• little human intervention 

• use catalog of reflectance versus land cover 

• delineate single land cover area rather than identify class 

Atmospheric Model /*=*/? + 5 
F ilm Model D — aX tn{I) + d 


Isotropic Scattering 


R^EAN 
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Surface Shape Recovery 

slant of ground plane 
surface shape 

• type of scattering 

- position and strength li^ source 

- surface dbedo 

- boundary conditions 
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Pli]rsk»l Modeb needed U» iniaprei uiege ORIGINAL PAGE A 

OF POOR QUALITY 

• Linenr fentvre Inder 

• Imsfe ciassific ttion 

• Shape recorery 

Physical modeb not aU eneompassinf 

• Evkbntid Reasonsof 



Primary Areas of Focus 
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• lina^to>Irotigv Corrf9poiKi(*nc« 

• rfgi»t ratios of mulliple dais sourcea 

• Imogr Segmentation • contexi:land>ase 

- scene entities 

• ‘Convergence of Evidence’ Decision Making 

- multi-source integration 

Approach 


• Pli>sical Modeling 

• (ieneric Techniques based on Stable l^perties 


• Discover Stable Attributes 
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Reduction and Utilization of 
Speckle Noise in SAR Imagery 


Daniel Held 
Jet Propulsion Lab 
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Progress in the Scene-to-Map Registration Task 


David D. Dow 

National Space Technology Labs 


RTOP : SCENE-TO-MAP REGISTRATION COMPARISON FOR LANDSAT MSS AND 
THEMATIC MAPPER DATA 
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(A) HYPOTHETICAL GROUND 
CONTROL POINTS ON A 
UTM GRID 
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(B) SArffi POINTS ON UNCORRJiCTED 
LANDSAT DATA (NOTE THE 
DIFFERENT OfUENTATlON) 




(f) SAME I’HINTS ON CiEO-IU’.i'I'.KKNCFD 
LANDSAT DATA (olUFMTATTON MAS 
BEEN ROTATED) 
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. A 1 



Distorted Input 
Image 


Earth Surface 

Geodetic 

Coordinates 


Map Projection Projected Output 

Plane Image -interpolation 

Grid 


Where mapping function relates 

(E,S) = Ts Tp Tc (e,s) = T(e,s) 

and Ts, Tp and Tc are vector functions 


GEOMETRIC REGISTRATION PROCESS AND ITS APPLICATIONS 





FUNDAMENTAL RE SEARCH 
STUDY AREAS 
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INDEPENDENTLY CHOSEN CONTROL POINTS (LATITUDE, LONGITUDE. ROW2 , COL2) COMPARED WITH 
LANDSAT COORDINATES (ROWl , COLl) DETERMINED FROM P-FORMAT REGISTRATION FOR DATA SET 
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OF POOR QUALITY 


B. RANDOM DISTRIBUTION OF POINTS 



c. clustb:red distribution of points 



MAJOR CATKGORIES OF GROUND CONTROL POINT DISTRIBTUION 





GEOPEF TEST APvEA: 20% LAND SAT SCENE 
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FUNDAMENTAL RESEARCH DATA BASE 


At the request of Dr. R. P. Heydorn, a fundamental research data base has 
been created on a single 9-track 1600 BPI tape containing ground truth, 
image, and Badhwar profile feature data for 17 North Dakota, South Dakota, 
and Minnesota agricultural sites. Each site is 5x6 nm in area. Image data 
has been provided for a minimum of four acquisition dates for each site. 

All four images have been registered to one another. A list of the order 
of the files on tape and the dates of acquisition is provided in attachment 1 . 

Attachment 2 provides information on the format of the ground truth tape 
and a table for each year to use in interpreting the information on the 
ground truth tape. Ground truth codes vary depending on the year. Like 
the Landsat image files, ground truth files cover an image 196 pixels wide 
by 117 lines long, but the actual size of the ground truth image is 392 
pixels by 234 lines. The reason for thi< difference is that there are 
six ground truth subpixels for each Landsat pixel, as illustrated. 


Cl 

Cp 

Cl 

C4 

Cs_ 

Cs 


Landsat Pixel Ground Truth Pixel 


The symbols Cj, C 2 , C 3 , C 4 , C 5 and C 5 represent the ground truth crop code 
for the various sub-parts of the Landsat pixel. We typically use a plurality 
rule to decide on a single label for a Landsat pixel. 

All files are stored on tape in universal format. Image files and Badhwar 
profile feature files contain four channels of data, but since three Badhwar 
profile features are provided in the feature files (tp, 0 , and Gniax)fbe fourth 
channel is always zero. The format for image and profile files is the same 
and is provided in attachment 3. 


PRECEDING PAGE BLANK NOT FILMED 
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6-10 / 1394 78 NO 120 174 211 220 238 

11-15 , 1531 77 MT 112 129 147 184 220 

16-20 1 1537 78 122 141 159 194' 221 

21-27 \ 1544 78 MT 104 122 140 158 176 221 230 

28-32 ) 1553 78 MT 122 194 203 211 220 

33-37 / 1566 78 MN 115 133 169 196 232 

38-43 1619 77 NO 122 140 158 175 176 230 

44-48 \ 1636 78 NO 135 154 190 207 226 

49-53 / 1650 78 NO 156 191 209 218 236 

54-58 1653 78 136 154 155 191 208 

59-63 1663 77 NO 121 138 156 174 211 

64-68 1676 79 SO 120 165 184 211 237 

69-73 1755 79 SO 120 147 166 184 220 

74-78 1784 78 SO 133 169 196 223 241 

79-83 1825 78 MN 133 196 206 223 224 

84-88 ' 1899 77 NO 122 140 157 175 193 

89-94 Image 1920 78 NO 101 136 199 209 217 236 


File Type Segment 

“95" -fr ■ lOT" 

96 , 1394 

97 ( 1531 

98 1537 

99 1544 

100 1553 

101 1566 

102 1619 

103 1636 

104 1650 

105 \ 1653 

106 j 1663 

107 167b 

108 \ 1755 

109 1784 

no 1825 

111 1899 

112 1920 


File 

“m 

Type 
Profi le 

Segment 

■ tSo’ 

114 


1394 

115 

( 

1531 

116 

] 

1537 

117 


1544 

118 


1553 

119 

1 

1566 

120 

{ 

1619 

121 

\ 

1636 

122 

/ 

1650 

123 

\ 

1653 

124 

/ 

1663 

125 

\ 

1676 

126 


1755 

127 


1784 

128 


1825 

129 


1899 

130 


1920 


Two end-of -files 
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OF POOR QUALITY 

3.2.1 HEADER RECORD 

The Header Record is the first record on the tape and contains 
3060 bytes (8 bits per byte) . The record is zero filled except 
for those bytes listed in the following table. The ilues 
contained in the listed bytes are all constant except for bytes 
61 through 63. The attached tape format contains identif icaticn 
and descriptions for each byte. The description and format of the 
Header Record is contained in jattachment 3. 


Bvtc 

- ^ — - 

Value 

Byte 

Value 

Byte 

Value 

61 

Day 

96 

1 

111 

120 

62 

•Month 

97 

-120 

1778 

1 

63 

Year 

100 

2 . 

1786 

1 

81 

-128 

101 

28 

1787 

1 

89 

1 

104 

1 

1788 

-120 

■90 

1 :* 

106 

70 


- • 

-91 

8 - 

109 

1 


.... 

.53 

1 

no 

1‘ 


^ r — 


Each video scan line is 504 bytes long; a 2-byte record counter, a 70-byte 
ancillary block, and 392 bytes of ground truth (two of the six subpixels for 
a 196 pixel scan line). It takes three video scan lines to complete one 
scan line of ground truth. See the following page for diagram. 
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Each video block will be the same number of bytes in length. If 
this tape contains raw data the PCM sync words associated with 
the video data, if any, will be included, with the video data on 
this tape. If this tape contains processed data, no sync words 
will be present. 

The arrangement of data for each pixel is shown in the following 
diagram. Data for subpixels 1 and 2 for pixel 1 is found in 
bytes 73 and 74 of the first data record. Data record 2 and 3 
contain data for suppixel 3 through 6 in the same format as 
record 1. 


Record Byte 

73 74 75 76 
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Corn 

(C) 

117 

142 

Safflower 

(5F) 

118 

143 

Sunflower 

(SU) 

119 

144 

Durum Wheat 

(OW) 

120 

145 

Sorghum 

(SR) 

121 

146 

Soybeans 

(SY) 

122 

147 

Sugar Eeets 

(SB) 

123 

143 

Winter Wheat 

(WVJ) 


149 

Spring Wheat 

(SW) 


150 

Spring Barley 

(BS) 


151 

Rye 

(R) 

1 127} 

152 

Flax 

(FX) 

128 1 

153 

Spring Oats 

(SO) 

129 ! 

154 

Fall Oats 

(FO) 

\ 

155 

Fell Barley 

(FB) 


156 

Cotton 

(C?I) 

mm 

157 

* Peanuts 

(PN) 

133 

158 






Grass (G) 

h'^y. sud,w», . Miiitl 


Pasture (?) 

Trees (T) 


♦Open - to be assioned as needed 


Has cure ” 
* Mix (PM) 

1 cp 

v:w CO 

* SM Grain 

1C? 


a1 
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Crop Type 
• 

Crop 
• Key 

Crop Harvested 

Crop Abandoned 

- Alfalfa 

.4H 

101 

15i 

Buckvoheat 

BW 

102 

152 

Barley 

BR 

103 

153 

Clover 

CL 

104 

154 

Corn 

CR 

105 . 

155 

Cotton 

CT* 

106 

156* 

Dry Bean 

DB 

107 

157 

Durum Wheat 

DW 

108 

158 

Flax 

FX. 

109 

159 

Hillet 

ML 

no 

160' 

Oats 

OA 

111 

161 

Peanuts 

PE 

112 

162 

Potatoes 

PO 

113 

163 

Rice 

RI 

114 

164 

Rye 

Rf 

115 

165 

Sugar Beets 

SB 

116 

166 ‘ 

Sugar Cane 

SC 

117 

167 • 

Safflower 

SF 

118 

168 

Soybeans 

SO 

119 

169 

Sorghum 

SR 

120 

170 * 

Sunflower 

SU 

121 

171 

•Spring '..'heat 

SW 

122 

172 

Tobacco 

TB 

123 

173 

Vegetables 

VE 

124 

174 

'Winter Wheat 

WW 

125 

175 

Small Grains/Strip Fields 

-- 

126 

176 

* 


127 

177 

* 


120 

178 


Grasses 

GS 

131 

, 1 n w— p 

Other Hay 

OH 

132 


Orchard/Vineyards 

OR 

133 


Pasture 

PA 

134 


Trees, 

TR 

135 


Water > 5 acres 

WA 

136 


Non-Agriculture 

XX 

140 


Idle Land/Fallow 

IL 

231 


Previous Year 




Residue/Stubble 

R 

232 


Mixed Crop in Field 

M 

233 


Problem Field 


99 


llon-lnventoried Land 


255 



Crop Marv?:tej 
. for Sile 


201 

202 

203 

204 

205 

206 

207 

208 

209 

210 
211 
212 

213 

214 

215 

216 

217 

218 

219 

220 
221 
222 

223 

224 
• 225 

226 

227 

228 


*0pen--to be assigned as needed (through code 130). Other open codes' include 137 
through 139, 141 through 150. ISl through 200, 234 through 254. 


tel 



ATTACHMENT 3 


232 

UNIVERSAL FORMAT TAPE HEADER RECORD FORMAT (3060 Bytes) 

BYTg 

CONTCrrS 

ORIGINAL PAGE IS 
PESCRI?7lo:i OF POOR QUALITY 

1-32 

UCIE 

Coaputing systea id-EBCDIC 

•33-38 

rooooc 

SnUgit unload tape nuaier 

•39-52 

FTIDODI^SISSTK 

BUNU> (E3CI3IC) 

53-80 


Sensor id-Z5CDIC 



Sate of this tape generation 

8l 


Day of conth - Binary 

62 


Kontb nusber - Binary 

63 


Year - last 2 digits - Binary 

6b 

8 

Daily tape serial nuaber - Binary 

6$-66 


IRTS nission number - BJ' t^ry 

1 ■ ia?s A 

2 - EcvTS B 

67-68 


Site - Binary (saaple segment nuaber) 
Itange 1-5COO 

69 

00000000 

Line - Binary 

70 

00000000 

Bun . Binary 

71-72 


Orbit nuncer of new data - Binary 

73-80 


Tine of first scan in this job (for LACIZ 
this is the tine of the center scar, of the 
SITS scene containing the sar.ple se^ent 
to the last ten seconds) 

73-7b 


Tenths of seconds x 1000 - Binary 

75 


Seconds - Binary 

76 


Minutes - Binary 

77 


Boui'S > Binary 

78 


Day of Donth - Binary 

79 


Month number - Binary 

60 


Year - last 2 digits - Binary 

81-68 


Bands active in this Job, 1 bit per band 
left to right (MSS to LS3), Video data 
always appears in the order indicated 
here. 1 « active. 

8l 

niioooo 

Bands 1, 2, 3« b active 

82.68 

0 

Bands 5-6U not applicable to LACIE 

89 

0 

Processing flag - raw data - Binary 

90 

k 

Runber of bands in this job - Binary 



BtTE 

91 

92-93 

9*»-93 

96-97 

9&-99 


COWTEWTS 

6 

X 

0 

196 

0 


100-101 900 

102 0 

103 0 

1(A 1 

105-106 70 

107 0 

108-109 1 

110-iu 196 


112-623 


012-119 0 

120-239 0 

Slt0^li7 0 

2*«8-367 0 

368-369 1 

370-371 1 


ORIGINAL PAGE IS 233 

OF POOR QUALITY 

psscRiPTio:; 

Xusxber of bits in a picture cleaent - Bin 

Address of start of video data gives loca* 
of start of video vithin scan - Binary 

Jlddress of start of first calibration arcs 
vithin the scan - Binary 

Kufflber of video elements per scan vithin 
a single band - Binary 

Kuaber of calibration elenents in the first 
calibration area vithin the scan in a 
single band - Binary 

Physical record size in bytes - Binary 

Kuober of bands per physical record of data 
set starting vith the second record of the 
data set - Binary 

Huaber of physical records per scan per 
hand - Binary. Zero unless the eleaents 
per band is greater than 3K. 

Ihraber of records to aa)ce a cocplete data 
set - Binary. 

length of ancillary block in bytes - Binary 

lata order indicator - Binary 0 " video 
ordered by bi'nd 

Start pixel nuaber nu.-aber of the first 
■pixel per scan on this tape referenced to 
the start of the scan - Binary 

Stop pixel nunber miaber of the last pixel 
per scan on this tape referenced to the 
start of the scan - Binary 

Coefficients and exponents-of-ten to linearly 
translate ?ara.ncter values froa up to 61* 
bands to engineering units. Tvo bytes per 
cocfficicr.t or exponent vith each pair of 
^rtes expressed in signed binary. (MSB a 
sign bit: O 5 +, 1=-. (Reaaining 15 bits 
straight binary). 

AO coefficients for bands l-l< 

Bands 5-6U not applicable to LACIP 

£0 exponents of ten for bands 1-b 

Bands 5*'6U not applicable to LACIE 

A1 coefficie.tt for band 1 

A1 coefficient for band 2 


234 


BYTE 

371-37? 

37*1-375 

376-I95 

^96-503 

50*1-629 


62*1-687 


688-751 

752 

753 


cobtet:ts 

1 

1 

0 

0 

0 


DFSCTI??IOy 

JLL eo«rfieient for bond 3 
A1 coefficient for bend ^ 


ORIGINAL PAGE 19 
OF POOR QUALITY 
* 

V 

V 


Bende 5-6*i not eppliceble to LACIS 


£1 exponents of ten for bends l-*i 

Bends 5 - 6*1 not applicable to LtCIE vhsre 
for each band Y » Engineering Units, C = 
Barereter Value: Y « A •10*‘»E + C«A 

•10««E 


To be euppUed by JSC Color code inforaetlcn - one byte per 

band in sane order as channel active on 
this tape" indicator - Blnarye 0 no 
color assignnent 

g Seale factor - one byte per band in sane 

prder as "channel active on this tape" 
indicator - Binary 0 = not active 

g Offset constant - Binary 

Word size of generating co-puter. Tnis is 
the smallest cuantity in bits that the 
cocputer con vrite on tape. 


75*»-1777 

75*1-769 0000050000000600 
770-785 0000060OCOOO0700 
786-801 0000070000000800 
802-817 0000080000001100 
818-1777 0 

1778 1 
1779-1780 0 
0781-1782 0 


1783 0 

178U 0 

1785-1786 U 
1787-1788 196 


Shortest and longest vave-length of each 
band - EBCDIC. Eight bytes per linit, I 6 
bytes per band - nil! iclcrons 

Band 1 - EBCDIC 

Band 2 - EBCDIC 

Band 3 - EBCDIC 

Band *1 - EBCDIC 

Bands 5-6*i not applicable to LACIP - EBCDIC 

Bvanber of data sets per physical record - 
Binary 

Address of start of second calibration 
vitbin a scan - Binary 

Kuaber of calibration clenents in the second 
calibration area vithin the scan in a single 
bend - Binary 

Calibration source indicator - Binary 
Till zero. 

Bucber of bards in the first record of the 
data set - Binary 

Total nunber of elenents per seen, per band - 
Binary 



BTO 

1789-17i?0 


COrfTET.TS 

1 


1791-1791 1 


1793-291*0 


1793-2066 

2087-a5l* 

2087-2091* - x . x 3 joc ‘: 
2055-2102 tx.XXXXX 

2103 

210; 


2105-ao6 

2107-2109 

2110 

.2111 

2112-2120 


2121 

2122 


2l23-a31 


pMiafe, IS 

DgSCRlPTIPy^ OF POOR QUALITY 

Pixel skip fatter - the quantity to he 
to the nuabe/ ..f the last pixel process 
jrield the nur.her of the next pixel to be 
processed - Unary 
1 « Process every pixel 

Scan skip factor - the quantity to he ad^ 
to the r.unbcr of the last scan processed 
yield the nur.her of the next scan to be pift- 
cessed - 3inar/. 

1 •> I^ocess every scan 

General inf n:ation. Information in I3CDIC 
generated to satisfy user requirements. 

Contents v'.ll he unique for each user cn4 
. depend not only on the sensor, hut also on 
specifications of the user for vhen the tape 
Is gen«*rai.ed. Ej'tes for vhich user specific 
no req'^rerents vill contain fill zeros. 

nv zeros 

Ce,e: -1 annotation byte assigneent for.dlS 
lACIE 

Peak sharpness - EBCDIC 

Honualized peak to background ratio - ZECDIC 

lianual registration flag 

0 ■» Automatic 

1 « lUnually assisted 

Zero fill flag - Sinar/ 

0 The sample segment contains no zero fill 
data 

1 » Part of the sample segment contains zero 

fill data 

Orbit number of reference data set - Binsry 
(not used 0) 

Zero fill 

Cloud cover - Binary - percent of 10X31 IM 
search area covered by clouds 

Zero fill 

IRTS sccne/frame id nur.her for reference data 
set - EBCDIC - AODOHnlC'^ (sec bytss 2123-2131 
for content) 

Zero fill 

Flag indicating vhether a reference scene has 
been used for registration - Binary 

0 hasn't been used 

1 ■ has been used 

ERTS scer.e-frame id nunber for nev data-EBCDIC- 
ADDDUKCIS 


co?iTEirrs 


I'-scsiPTio:: 


236 

BYTE 

gL2? 

212U-2126 

2127-2128 

2123-2130 

2131 

2132 

2133 


X • £RTS nisjLion nusber 

ADD “ J)&/ n«ber rel&tlve to louneh At time 
of observAtlon 

JOS, ■ bour At tiae of observAtlon 
K( » ainute At tine of observAtlon 
8 * tens of seconds At tine of observeticn 
2ero fill 

■DatA quality clessificAtion 
0 “ accept Able 
3. e narginel 


213J*-2li»5 


■ Center of sar.ple se^snt - EBCDIC right 
Justified and padded vlth zeros 

213**-2139 


latitude 

213** 


V «* Borth "S” = South 

2135-2137 


Degrees - integral 

2138-2139 


Woutes - mtesral .3 

2lU0-2ll»5 


longitude OF POOR QUALITY 

ZLliO 


**E" « East; = West 

2lUl-2ll*3 


Degrees - integral 

2lUI*r2lU5 


Klnutes - integral 

21^6-21^9 


Band sync status - Binary - the nunber of 
lines for vhich s^.t.c could not be cair4tained 
during pre-processing by band 

21^8 


Band 1 

21*»7 


Band 2 

2llt8 


Band. 3 

2ll<9 


Band 4 

2150-2156 


2cro fill 

2157-2170 


Sun angle - EBCDIC 

2157-2162 

SU1.*^ZL 

•sun pJ* - EBCDIC 

2163-216U 


Sun elevation - integral degrees EBCDIC 

2165-2167 

ISAZ 

■ ■A2” - EBCDIC 

.2168-2170 


Sun aziauth - integral degrees - IBCDIC 

2171-2178 


fine and date of last update to controlling 
infoxsation - EBCDIC - YDDDHrICI 

2179-218U 


2ero fill 


Brr£ 

coirraiTs 

ORIGh\'AL PAGE iS 

OF POOR QUALITY 237 

UESCBIPTICi 

• 


£un iLDfiles are 2 Bjrte Binary 

•2201-2202 

• 

Sub angle for BS£C cbaxinels 1—1* 

•2203-220U 


- Sub angle for RSEC chanaelt 5-8 

•2205-2206 


Sun angle for RSEC channels 9—12 

•2207-2208 


Sun angle for F.SEC channels 13-l6 

! • 22 U 9 

OTDD 

Ist ac<iui$ition date (characters) 

1 *225^ 

X 

■ Average soil greexuiess for IsB ac%uislticn 
(binary nuaber) 

•2257 

raoD 

2nd acquisition date or blanks 

, «2262 

X 

Average soil greenness for 2nd acquis it icn 

•2265 

nODD 

3rd acquisition date or blanks 

•2270 

X 

Average soil greenness for 3rd acqixisitior. 

•2273 

nODD 

^th acquisition date or blanks 

•2278 

X 

Average soil greenness for l*th acquisition 

255I-26U2 

0 

General annotation byte assignsents for 
the cyber at JSC 

261»3-25U0 


General annotation b>*te assignrents for the 
production fiia converter 

26li3-2658 


•Bias factors and scaling factors - signed 
Binary. Four bvtes per channel, vhere first 
tvo bytes = bias factor; second tva bytes * 
scaling factor. Each factor has an implied 
deciral point to the left of the least 
significant decinal digit. If 1*33 * 1 
the factor is negative; if the ^3B * 0 
the factor is positive. 

•2U3-26U6 


Channel 1 

•26U3.261j1* 


Bias factor 

•261*5-261*6 


Scaling factor 

• 261 * 7-2650 


ChazmeX 2 

•261*7-261*8 


Mas factor 

^ 261 * 9-2650 

- 

-baling factor 

: • 2651 - 2651 * 


^^annel 3 

12651^2652 


^ Bias,, factor - 

• 2653 - 2651 * 


-baling factor _ .E;* ‘ ''* ■'- . 

■ 2655-2658 


- Channel 1* 

■ 2655-2656 


Bias factor 

• 2657-2656 


Scaling factor 


238 

3YXS coirfEirrs 

•26^9-2606 


ORIGINAL PAGE £3 
PcSCRI?7I0:t OF POOR QUALITY 

Bias factor and scalinf; factors for 
chaxincls $*-l6 In the saae forest as above. 


2758 

2T59 1 

•2160-2783 
•2764-2789 
2790-2792 0 

2793-279** 0 

2795 1 

2796 0 

2797 1 

2798 0 

’2799 2 


U thousand scan lines per fraae - Binary 

User 10 

■Blanks 

Altitude in Deters - Binary 

Ground speed in MET/SEC - Binary 

Scan Type - Binary 
00000000 = F.av data 
00000001 - Saootked data 

Angle of ABC in degrees - Binary 

Caaera - Binary 
00000000 * 70 
00000001 * 5 inch 

Input device - Binary 
00000000 = 9-track 
00000001 = high density tape 

truncation 
0*2 lev order bits 
1*2 high order bits 
2 * no trxmcations 


2800-2807 


Channels requested. 1 bit per channel - 
Binary 


-2800-2801 11110000 00000000 (lacq) 
amilll OOOOOCOO (2 acq) 
30111111 llllOCCO (3 acc) 
nimm inn 111 (4 acq) 

2802-2807 0 

2808 0 


Channels 1, 2, 3| ** requested 


Channels l6-64 not applicable for Unload 

Processing node - Binary 
00000000 * serially 
00000001 * concurrently 


2809-2824 0 


2809-2310 

2811-2812 

2813-2814 

2619-2816 

2817-2818 

■2819-2820 


Density for eight saturated colors - tvo 
7>ytes pe." saturated color - Binary where 
first bj'tc « lev intensity level of the 
range; second byte = high the range of the 
Intensity level is 0 to 293 

Bed density, range 

Blue density range 

Green density range 

llagenta density range 

Cyan density range 

Yellow density range 



239 


omcmr:^ tagc is 

OF POOR QUALITY 


BYTE COtlT£??TS 

2621-2322 

2623-282<4 

282$ To Be supplied by JSC 

282e-2373 0 

287!) 0 


2875 0 


2876 6 


2877 8 


2878-2881 
2878-2679 0 
2880-2861 0 

2882-2863 0 

2881t 0 

2885-2886 0 

2885 
2686 


BzscsiPTio:: 

Vblte density rmnce 
Blsck density rsnge 

riln processing fleg 

0 ** Process this file 

1 " Skip this file 

Pill zero 

Color select* - Bic&ry 

0 “ No color 

1 •» Assigned color 

2 * Pslse color 

3 ■ SstUTAtcd color 

Xoage forr.at* - Binary 

0 * Single image 

1 ** Enhanced images 
2 'k Abut images 

3 « Offset images 

Bepeat of pi* els per scan - Binary 

0 K None 

1 « 1 repeat 

2 » 2 repeats 
s ■ n repeats 

Repeat of scan - Binary 

0 *• none 

1 « 1 repeat 

2 « 2 repeats 
n « n repeats 

Partial scan - Binary 

Start pixel nimiber 

Stop pixel numter 

(if bytes 2787-2861 contain all zeros , 
full scan is expected - not partial) 

Sensor scan rate in scans/second - Binary 

Pixel size - Binary 

Angle of drift - Binary 

— integer degrees 

' IVaetioa 


26S7-29t»0 0 

29^1-3000 LACirdJroPFJi . . .U 

3001-3060 0 


Jill zeros 

Title - user designated identification 

Jill zeros, makes the record an integral 
nuaber of cemputer uords. These bytes 
Bust never contain data* 


240 


ORIGINAL PAGE ^ 
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3.2.2 DATA SETS 

The data follows the Header Record and is arranged in data sets. 

A data set is defined as the ancillary data and all of the video 
data for one scan line for all active channels. Data sets are 
recorded in variable length physical records containing a 
maximum of 3000 bytes of information per record. Since 3000 bytes 
is not compatible with the word length of all computers, the 
record includes a sufficient number of fill zero to make the recor 
divisible by 32, 36, 48, and 60 bits. However, the maximum 
length of the record may not exceed. 3060 bytes. If two are more 
records are needed for the data set, the data set will be divided. 
Under no condition will the data for a video channel begin in one 
record and continue into another record. 

The first two bytes of each record will contain the number of the 
physical record within the video data set. This is for use in 
data sets that contain more than 3000 bytes and therefore require 
more than one physical record for recording. The ancillary block 
is the first block of a data set and follows the record counter. 
The length of the ancillary block is variable, with the number 
of bytes civeh in the header record. 

Bytes 73 through N will be dependent on whether this job contains 
raw processed data (Byte 89 of the header record) . The value 
of N will be given in bytes 105 and 106 of the header record and 
will always be greater than or equal to 70. 

If this job contains raw data bytes 73 through N will contain the 
housekeeping data channel from the sensor, if one is available. 

Following the ancillary data in each data set will be the video 

data for the one channel for one scan. The video data for the 
channel for cne scan will comprise a video block. 



UNIVERSAL FORMAT TAPE ANCILLARY BLOCK FORMAT 


241 


BYTE 

^-70 


COirrET%TS ' I)SSCRlPTIOiy 

0 Zero fill 

iltlative scan line auaber 


ORJOTa ^3 

OF POOR QUALITY 


UNIVERSAL FORMAT SCAN LINE FORMAT (900 Bytes) 


242 


reaper 


me 


DATA 5&T 1 Variable mim- 

K«»y A# hyii»* -■ 



ORIGINAL PAGE IS 
OF POOR QUALITY 


ha 

Kolct 

The number o! bytes for each 


^ N 

data aai will be the same in 
each data run. 


me 


'O 

o 

0 


(DATA RUN 1) 


IRC 


DATA 5ET 6 (line 6) Ytri- 
able ler.|»th 


IRC 


o 

e 

o 


me 


DATA SET 117 (t«ne 117) 

ISL 


header 

_EQr 


(DATA RUN 2) 


K£/J)ER 

EOF 

EOF 

EOF 


1 


ONE SAMPLE SECMENT 


A and B are retrieved Iron* the image 
data base* 

A*^’ LSIMACHD , master hca«ier 
B* LSIMVHDR. LSIMCHaN. LSLMLAKD, 
Imagery data 


CB,) 


RECORD COUNTER 

2 bytes 

ANCILLARY BLCCn 

70 bytes 

LINE J. BAND 1 
BAND 2 
BAND 3 
f AND 4 

195 bytes 

196 bytes 
196 bytes 

^ISs.byicA. 

ttaorm 


•DATA SET FOR 1 ACQUISITION, 
i CHANNELS 


SOO BYTZS/RECORD 


■ ■ I II I I !■ ■■■ !■ II ■■ i^ii « I 

Tisure 3*1S« ITC Unload Tape (sheet 1 of 2] 
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iRECORO..COtJWT£R,_ 

1 bytes 

ANCILLARY BLOCK 

"0 bytes 

LINE 1, BAND l" 

19o bytes 

BAND 2 

196 bytes 

BAND 1 

196 bytes 

BAND 4 

196 bytes 

BAND 5 

. 196 bytes ; 

BAND 6 

196 bytes 

BAK’D 7 

196 bytes 

BAND 8 

196 bytes 

BANT) 9 

196 bytes 

BAND 10 

196 bytes 

BAND 11 

196 bytes 

BAND 12 

196 bv‘es 

jzERO FILL 

96 bytes 


DATA SET FOR THREE ACQUISITION, 
, 22 CHANNELS 

2520 BYTES/RECORD 


^ote: For a 26'channcl data set, hvo (3^) data acts will be required therefore 

reqiLtiring two physical records. 


Figure 3-15. 


PFC Unload Tape (Sheet 2) 


